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ABSTRACT 

In  link-state  routing,  routes  are  determined  based  on  estimates  of  the  current  delays  on  the 
links.  Ideally,  a  data  packet  should  be  routed  based  on  the  delays  it  will  encounter  at  each  link 
of  the  path  at  the  time  the  packet  gets  to  the  link.  To  address  this  issue,  we  have  developed  a 
new  approach  that  improves  link-state  routing  by  estimating  and  using  the  future  link  delays 
encountered  by  data  packets.  In  link-state  routing,  link-delay  estimates  are  periodically  flooded 
throughout  the  network.  This  flooding  of  link-delay  estimates  is  done  without  considering  the 
relevance  of  these  estimates  to  routing  quality.  Our  approach  also  improves  link-state  routing 
by  broadcasting  these  estimates  only  to  the  extent  that  they  are  relevant.  Simulation  studies 
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suggest  that  our  approach  can  lead  to  significant  reductions  in  routing  traffic  with  noticeable 
improvements  of  routing  quality  in  high-load  conditions. 

1  Introduction 

In  a  packet  switched  network  a  collection  of  nodes,  consisting  of  computing  machines,  is 
connected  using  communication  links  capable  of  transferring  information  in  the  form  of 
packets,  from  one  node  to  another.  When  a  direct  link  does  not  exist  from  the  source  node 
and  the  destination  node,  but  a  path  via  one  or  more  intermediate  nodes  exists,  the  packets 
from  the  source  node  follow  this  path,  such  that  each  intermediate  node  carries  out  a  store- 
and-forward  operation  until  the  packets  are  delivered  to  the  destination  node.  The  path  is 
determined  through  “routing”  techniques.  Clearly  routing  is  an  operation  which  has  to  reply 
on  the  global  state  of  the  network.  Several  techniques  have  been  used  for  collecting  and  using 
global  information  for  routing.  One  such  technique  is  link-state  routing  in  which  each  node 
collects  information  on  the  state  of  its  outgoing  links,  usually  in  the  form  of  the  waiting  time, 
and  shares  it  with  all  other  nodes  in  the  network.  Based  on  the  link-state  information  collected, 
a  node  may  determine  the  “best”  path  from  it  to  any  other  node  of  the  network. 

In  link-state  routing,  we  refer  to  the  global  link-state  information  that  each  node  maintains  and 
uses  for  routing,  as  a  view.  The  view  is  essentially  a  graph  with  vertices  corresponding  to  the 
network  nodes,  edges  corresponding  to  network  links,  and  for  each  link,  a  cost  representing  an 
estimate  of  the  current  delay  on  the  link.  Based  on  its  view,  each  node  determines  least-cost 
paths  to  all  other  nodes  as  the  best  paths.  The  end-to-end  cost  function  is  the  sum  of  the  costs 
at  all  the  links  in  the  route. 

Each  node  makes  (periodic  and/or  event-driven)  measurements  of  the  current  delay  for  each 
of  its  outgoing  links.  It  periodically  constmcts  an  estimate  for  the  current  delay  on  the  link 
from  these  measurements  as  link-cost  estimates,  and  sends  these  link-delay  estimates  to  all 
other  nodes  in  the  network.  When  broadcasting,  a  node  sends  link-delay  estimates  for  its 
outgoing  links  to  its  neighbors,  and  each  of  the  neighbors  in  turn  sends  these  estimates  to  its 
neighbors,  and  this  continues  until  all  nodes  receive  the  estimates.  This  broadcast  technique  is 
referred  to  as  flooding  [Peterson,  1996;  Rosen,  1980].  When  each  node  constmcts  a  link-delay 
estimate  for  a  local  link  (i.e.,  a  link  going  from  it)  or  receives  an  estimate  for  a  remote  link,  it 
updates  its  view  (view  update).  Each  node  periodically  uses  its  current  information  about  the 
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network  to  compute  least-cost  paths  to  all  other  nodes  (periodic  route  update)  by  using  the 
standard  shortest-path  algorithm  [Dijkstra,  1959].  These  least-cost  paths  are  used  by  the  node 
to  route  data  packets,  i.e.  when  the  node  receives  a  data  packet,  it  forwards  the  packet  to  the 
neighbor  that  is  the  next  node  in  the  least-cost  path  to  the  destination  node  of  the  packet. 

Consider  a  node  with  a  link  /  outgoing  from  it.  Let  x  denote  the  delay  on  the  link  and  t 
represent  time.  Assume  that  this  node  has  made  delay  measurements,  x_n  ,  ,  ...,  x_t  on 

this  link  at  time  t_n,  C(„_ 1)}  •  ••,  Cl5  respectively,  before  the  current  time  t0 ,  where  n  is  the 
total  number  of  measurements  and  time  tt  precedes  t,  if  i  <  j .  Say  the  node  makes  an 
estimate  of  the  current  link  delay  using  these  previous  delay  measurements.  Let 
x0(x_n,x_Ul_ly...,x_l)  denote  this  delay  estimate.  In  link-state  routing,  x0(x_n,x_{n_l),...,x_l)  is 

periodically  computed  and  flooded  to  all  other  nodes  so  that  each  node  can  use  this  estimate  as 
the  cost  of  link  /  when  computing  least-cost  paths  to  all  other  nodes. 

In  link  state  routing,  there  is  a  key  issue  to  consider:  each  node  creates  a  delay  estimate  x  for 
an  outgoing  link  and  sends  it  to  all  nodes.  This  estimate  is  based  on  measurements  made  in  the 
past  and  its  value  to  a  receiving  node  may  decrease  over  time,  to  the  point  that  the  new 
estimate  may  not  lead  to  any  changes  in  the  view  of  a  node  receiving  it.  In  this  report,  we 
examine  this  issue  by  reflecting  the  changes  in  the  estimates  over  time  and  take  such  changes 
into  account  for  not  only  the  routing  decisions  but  also  the  flooding  decisions. 

1.1  Link  State 

Many  variations  of  the  standard  link-state-routing  approach  described  above  have  been 
proposed,  where  link-state  information  in  forms  other  than  that  of  link  delays  is  used  in 
routing  (this  means  that  link  costs  do  not  represent  delays).  This  is  primarily  because  the  ways 
that  link  delays  have  been  used  can  lead  to  inferior  routing  performance,  say  due  to  routing 
instabilities.  For  example,  routing  performance  can  be  degraded  because  of  routing 
oscillations,  where  given  two  links  connecting  two  regions  of  a  network,  the  preferred  route 
from  one  region  to  the  other  for  most  or  all  inter-region  traffic  is  constantly  switched  because 
most  or  all  traffic  shifts  at  the  same  time  due  to  all  nodes’  simultaneous  adjustment  of  their 
routes  with  the  same  reported  delay  values  for  the  links  [Khanna,  1989]. 
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Historically,  the  original  ARPANET  used  queue  length  as  the  link-cost  metric.  However,  this 
metric  was  not  effective  because  it  did  not  take  either  link  bandwidth  or  the  latency  into 
account.  The  original  scheme  was  revised  to  consider  the  bandwidth  and  latency  by  using  delay 
averages  as  link  costs.  However,  this  revised  scheme  caused  routing  instabilities  under  heavy 
load,  resulting  in  routing  oscillations.  For  stable  routing,  the  ARPANET  metric  was  again 
revised  to  a  hop-normalized-utilization  function  [Khanna,  1989].  This  function  computes  a 
link  cost  by  normalizing  an  estimate  of  the  link  utilization  via  a  linear  transformation  after 
making  this  estimate  with  measured  delay  values.  (The  idea  behind  this  computation  is  hop- 
normalization,  which  means  normalization  of  the  utilization  in  terms  of  hops  so  that  the 
resulting  cost  is  relative  to  that  of  alternative  links.  To  illustrate  how  routing  is  done  based  on 
this  idea,  consider  the  case  where  61  is  reported  as  the  cost  of  a  link  ll  and  20  is  reported  as 
that  of  an  alternative  link  /2 .  In  this  case,  /2  with  additional  2  hops  is  used  in  routing  before  lx .) 
This  new  approach  smoothed  the  temporal  variation  of  the  metric  by  using  link  utilization 
rather  than  link  delay  and  using  a  movement  (metric-change)  limit,  and  compressed  the 
dynamic  range  of  the  metric  by  limiting  the  cost-value  range  and  considering  the  link  type. 
However,  the  benefit  of  using  this  kind  of  technique  to  damp  out  sudden  changes  or  routing 
oscillations  depends  on  the  network  and/or  traffic  pattern.  Recently,  there  was  an  attempt  to 
tune  the  parameters  in  the  link-cost  function  via  online  simulation  [Kaur,  2000].  Also, 
congestion-based  metrics  were  proposed  [Glazor,  1990].  However,  these  metrics  have  been 
unpopular  because  the  use  of  the  metrics  may  lead  to  routing  instabilities  [Kaur,  2000]. 

In  some  cases,  link  costs  are  not  recalculated  dynamically  and  constant  link  costs  are  used  most 
of  the  times.  In  these  cases,  the  computation  and  broadcast  of  link  costs  for  route  updates  are 
not  periodic.  For  example,  link  costs  are  set  statically  by  a  network  administrator,  and  these 
costs  are  changed  only  in  case  of  link  failure.  This  static  approach  may  be  effective  in  some 
small-scale  networks  in  which  there  are  few  or  no  alternative  paths.  However,  the  approach 
may  not  be  suitable  for  most  networks  in  which  there  are  many  alternate  paths,  because 
different  alternate  paths  may  become  more  or  less  desirable  as  link  delays  change  over  time. 

1.2  Approach 

In  link-state  routing,  each  node  makes  link-delay  estimates  based  solely  on  information 
provided  in  the  past,  and  uses  these  estimates  in  routing.  Ideally,  a  data  packet  should  be 
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routed  based  on  the  delays  it  will  encounter  at  each  link  of  the  path  at  the  time  the  packet  gets 
to  the  link.  That  is,  for  each  link  along  a  potential  route,  the  node  doing  the  routing  needs  an 
estimate  of  the  link  delay  at  the  (future)  time  when  the  data  packet  would  arrive  at  the  link.  We 
refer  to  this  future  delay  as  encountered  delay.  To  address  the  issue  that  routing  should  be 
done  based  on  encountered  delay,  we  have  developed  a  new  approach  to  consider 
encountered  delay  in  routing  by  estimating  this  delay  via  a  projection  technique.  This  technique 
is  described  in  Section  3.  Before  presenting  our  approach,  Section  2  provides  a  formal 
description  of  the  problem  of  estimating  encountered  delay  and  using  this  delay  to  determine 
least-cost  paths  in  routing. 

Also,  in  link-state  routing,  each  node  floods  its  link-cost  estimates  without  regard  to  whether 
the  estimates  are  necessary  for  determining  least-cost  paths.  This  could  result  in  a  significant 
amount  of  unnecessary  routing  traffic.  In  our  approach,  each  node  disseminates  link-cost 
information  only  when  necessary  for  estimating  encountered  delay.  We  have  found  that  our 
approach  leads  to  reductions  in  routing  traffic  as  well  as  improvements  in  data  performance 
(e.g.  delay,  throughput).  Section  3  also  presents  this  selective-broadcast  technique.  Our 
experiments  and  the  results  are  presented  in  Section  4.  In  this  section,  we  describe  the  network 
configuration  and  scenarios  for  our  simulation  studies,  and  present  the  comparison  results 
obtained  from  these  studies.  Section  5  briefly  surveys  major  related  works.  Finally,  Section  6 
concludes  our  work  and  summarizes  our  future  work. 
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2  Problem  Formulation 

For  a  link,  we  treat  the  delay  x  at  time  t  as  a  stationary  stochastic  process  {x(t)} .  Thus,  the 

mean  and  variance  of  x(t)  are  constant  (independent  of  time  t).  Let  m  and  <j~  denote  the 
mean  and  variance,  respectively.  Also,  the  autocorrelation  function 
E\{x(t)  —  m}  {x(t  +  t)  —  m}]/ a2  depends  only  on  the  lag  r  and  not  on  time  t.  Let  p(v) 
denote  this  autocorrelation  function. 

Consider  the  instantaneous  conditional  mean  and  variance,  respectively,  of  the  delay  given  a 
measurement  x0  at  time  t0 : 


E{x(t )  |  x(t0)  =  x0 }  ,  where  t0  <  t 
Var{x(t)  |  x(t0)  =  x0}  ,  where  t0  <  t 

If  no  other  measurement  is  available,  we  expect  the  instantaneous  conditional  mean  to  change 
from  x0  towards  m  over  time.  Similarly,  we  expect  that  the  instantaneous  conditional 

variance  to  change  from  zero  to  cL  over  time.  When  the  measurement  is  made,  the 
conditional  variance  is  zero  because  the  true  value  of  x  is  observed  at  that  time. 

For  the  determination  of  least  encountered-delay  paths  and  the  selective  broadcast  of  link- 
delay  information,  we  require  estimates  for  the  functions  E  { x(t)  \  x(t0 )  =  x0 }  and 

Var{x(t)  |  x(t0)  =  x0} .  Based  on  the  steady-state  behavior  explained  above,  we  need 
techniques  for  estimating  these  function  values.  The  routing  problem  that  we  address  is  how 
to  use  these  estimates  in  route  determination  and  selective  broadcast. 
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3  Approach 

We  assume  that  the  conditional  mean  decays  exponentially  over  time  to  its  steady-state  value. 
Based  on  this  assumption,  we  use 

m{x 0  ,t0,t)  =  x o  +  (m  -  x0 )(1  -  ])  (t>t0) 

as  an  estimate  of  E{x(t)  \  x(t0)  =  x0}  ,  where  a  is  a  non-negative  constant.  This  is  illustrated 
in  Figure  1.  Similarly,  we  use  an  exponential-decaying  estimate  cf2 (x0,t0,t)  for 
Var{x(t )  |  x(t0)  =  x0}  ,  as  illustrated  in  Figure  2. 

m(x0 


Figure  1  Evolution  of  the  instantaneous  conditional  delay-mean  estimate 

d2(x0, 


Figure  2  Evolution  of  the  instantaneous  conditional  delay-variance  estimate 
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Theorem  If  x(t )  is  a  stochastic  process  and  has  the  following  additive  form  for  a 
constant  m  and  a  positive  constant  At : 

x(t  +  At)  -  m  =  /?  {x(t)  -  m)  +  (1  -  j3)o(t) , 

then 

(i)  E{x{t)}  =  m  ,  Var{x{t)}  is  a  constant  (denoted  by  cr2),  and  the  autocorrelation  function 

P(t,t0)  =  E[{x(t(})  -  m)  {x(t)  -  m}]/ <j2 

(t  =  t0  +  k{At)  for  a  non-negative  integer  k )  decreases  exponentially  as  t  — 10  (or  k )  increases 
(depending  only  on  the  lag),  and 

(ii)  E{x(t)  |  x(t0 )  =  x0}  =  x0  +  (m-x0){  1  -  p(t,t0)} , 

where  /?  is  a  constant  such  that  0  <  j3  <\,  and  u(t)  is  an  independent  white-noise  process 
such  that  E{u(t)}  =  0  and  Var{v(t)}  =  E{v2(t)}  =  cr2  (positive  constant)  □  (proof  in 
Appendix  A  on  pages  23  to  26). 

Note  that  this  theorem  is  valid  for  arbitrary  t0  and  t  >  t0  if  there  is  a  non-negative  integer  k 
such  that  t  =  t0  +  k(At) ,  where  At  satisfies  the  additive  model  form.  We  can  choose  such  k 
and  At .  Thus,  we  can  apply  the  theorem  with  respective  to  arbitrary  t0  and  t>t0. 

Part  (i)  of  the  theorem  implies  that  if  x(t)  has  the  additive  form,  then  x(t)  is  stationary  and  its 
autocorrelation  function  decreases  exponentially  in  time.  When  we  examined  a  sample 
autocorrelation  function  for  a  set  of  Internet  round-trip  delay  measurements  made  using  the 
NetDyn  tool  [Sanghi,  1993],  we  found  that  the  function  decays  exponentially  in  the  short  term. 
The  additive  form  is  a  form  that  we  work  with.  Based  on  Part  (ii)  of  the  theorem,  we  make  the 
assumption  stated  at  the  beginning  of  this  section,  that  the  conditional  mean  decays 
exponentially  over  time.  Refer  to  Appendix  B  (pages  27  and  28)  for  the  additional  theorem 
that  explains  our  motivation  of  using  the  exponential-decaying  conditional  delay-variance 
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Figure  3  shows  a  sample  of  Internet  round-trip  delay  measurements,  and  Figure  4  shows  a 
sample  autocorrelation  function  computed  for  this  sample.  The  least-square  estimates  of  a 
for  different  sets  of  Internet  round-trip  delay  measurements  range  from  58  sec  1  to  73  sec  1 . 
Table  1  shows  these  values. 


Figure  3  Round-trip  times  measured  at  10  ms  intervals  between  the  University  of 
Maryland  at  College  Park  and  the  University  of  Illinois  at  Chicago  for  10  seconds 

from  20:46  on  04/09/99 


O  0.2  0.4  0.6  0.3  1  1.2  1.4  1.6  1.3  2 

Time  lag  (seconds) 


Figure  4  Sample  autocorrelation  function 

Table  1  a  values  estimated  with  round-trip  delay  measurements  made  at  10  ms 
intervals  between  Maryland  and  Illinois  for  different  start-times  and  durations 
on  04/09/99  (via  sample  autocorrelation  functions) 


Start-Time 

Duration  (Seconds) 

10 

20 

30 

20:46 

67 

71 

58 

20:51 

73 

66 

69 
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Given  these  exponential-decaying  estimation  functions,  a  node  computes  the  encountered 
delay  of  a  packet  on  a  path  as  follows.  Let  the  path  have  links  lx,  l2, ...,  ln ,  and  let  the  node 


send  the  packet  into  the  path  at  time  t0.  Let  ml'(t )  be  the  function  estimating  the 
encountered  delay  on  link  li  at  time  t .  The  estimated  encountered  delay  for  the  packet  on  link 
/ j  is  m]  (to).  The  estimated  encountered  delay  for  the  packet  on  link  /7  is  m2  (t0  +  m'1  (t0)), 
and  so  on.  So  the  estimated  encountered  delay  for  the  packet  on  the  path  is  given  by: 


in 


,x  (t0)  +  m'2  (t0  +  m'1  (t0))  +  m  3  (t0  +  m'1  (t0)  +  m'2  (t0  +  m'1  (10)))  + ...  +  mn  (...) 


Computing  path  costs  in  this  way,  the  node  would  route  the  packet  on  the  path  with  the  least 
encountered-delay  estimate.  Each  node  determines  the  least-cost  paths  using  the  standard 
shortest-path  algorithm  as  in  link-state  routing.  Thus,  routing  is  carried  out  as  in  standard  link- 
state  routing  except  for  the  path-cost  computation.  To  do  this  computation,  each  node 
maintains  a  view  as  in  link-state  routing  except  that  a  measured  delay  and  measurement  time 
are  kept  for  each  link.  The  node  updates  its  view  of  a  local  link  whenever  a  data  packet  is  sent 
on  that  link.  The  node  updates  its  view  of  a  remote  link  whenever  it  receives  a  measurement 
update  for  the  link.  View  updates  are  not  periodic.  Note  that  in  our  approach,  link  costs  are 
not  considered  as  part  of  the  link  views  in  contrast  to  link-state  routing. 


At  each  view  update  for  a  link,  each  node  updates  the  measured  delay  and  measurement  time 
that  it  maintains  for  the  link.  Each  node  broadcasts  the  updated  delay  information  to  its 
neighbors  only  if  the  estimated  encountered  delay  on  the  corresponding  link  at  that  time  is 
significantly  different  from  the  steady-state  mean.  We  assume  that  every  node  knows  the 
steady-state  value  of  delay  on  each  link.  In  our  approach,  the  estimated  encountered  delay 
becomes  close  to  the  corresponding  steady-state  value  over  time.  Hence,  no  propagation  of 
updated  delay  information  is  required  beyond  some  point.  If  a  node  does  not  receive  any 
measurement  update  for  a  link,  it  uses  the  steady-state  value. 


Each  node  maintains  a  routing  table  that  indicates  the  next  hop  for  each  destination  as  in  link- 
state  routing.  In  link-state  routing,  with  its  view  for  all  links,  each  node  periodically  updates  its 
routing  table  by  computing  the  least-cost  paths  to  all  the  other  nodes.  However,  in  our 
approach,  each  node  computes  link  costs  and  updates  routes  just  before  it  decides  which  of  its 
outgoing  links  to  send  the  packet  onto  when  it  receives  a  data  packet.  We  refer  to  this  update 
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technique  as  the  “just-in-time  route-update”  method.  This  method  allows  each  node  to 
determine  the  current  least-cost  paths  using  the  encountered  delay  estimated  with  the  most 
recent  delay  information  for  each  link.  Note  that  the  periodic-update  scheme  used  in  link-state 
routing  is  not  suitable  for  our  approach.  The  reason  is  that  if  the  periodic-update  scheme  were 
used,  routes  determined  using  our  approach  at  each  route-update  time  would  be  used  without 
any  change  until  the  next  route-update  time.  The  problem  with  this  is  that  temporally-changing 
estimated  encountered  delays  cannot  be  used  for  routing  of  individual  data  packets.  If  link- 
delay  estimates  made  in  the  case  of  using  the  periodic  scheme  are  close  to  the  steady-state 
values,  the  result  of  using  the  periodic  scheme  in  our  routing  approach  could  be  comparable  to 
that  of  using  link-state  routing.  However,  these  link-delay  estimates  can  be  different  from  the 
steady-state  values.  For  example,  consider  the  case  where  periodic  route  updates  occur  right 
after  link  delays  that  are  different  from  the  steady-state  values  are  measured.  If  these  measured 
values  are  used  to  make  link-delay  estimates  at  these  route  updates,  these  estimates  are  close  or 
equal  to  the  measured  values  that  are  different  from  the  steady-state  values.  Thus,  the  result  of 
using  the  periodic  scheme  can  be  negative. 

We  refer  to  our  routing  approach  based  on  estimates  of  encountered  delays  as  InfoDyn 
routing.  Table  2  summarizes  the  commonalities  and  differences  between  InfoDyn  and  the 
standard  link  state  routing  approaches.  In  both  approaches,  each  node  measures  the  delay  of  a 
data  packet  on  each  local  link  by  time-stamping  its  arrival  at  the  node  and  its  departure  from 
the  link  queue,  and  adding  this  time  difference  to  the  sum  of  the  packet  transmission  time  (the 
packet  size  divided  by  the  link  bandwidth)  and  link-propagation  delay.  We  refer  to  a  particular 
node  as  a  measurement  node,  and  a  node  that  uses  the  delay  measurements  made  by  this 
measurement  node  for  routing  as  a  routing  node.  In  this  table,  we  focus  on  the  measurement 
node,  local  link,  and  routing  node. 
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Table  2  Comparison  of  InfoDyn  routing  with  standard  link-state  routing 


Aspect 

InfoDyn  Routing 

Standard  Unk-State  Routing 

What 

Measurement  and 

Exponential  Delay  Average 

Measurement  Time 

(Link  Cost) 

Who 

Measurement  Node 

Measurement  Node 

Link-View  Construction 

How 

Measurement 

Exponential  Averaging  after 
Measurement 

When 

Measurement  Time 

Periodically 

(for  View  Update;  When 
Each  Data  Packet  Is  Sent 

(for  View  Update) 

Out) 

How 

Conditional  Broadcast 

Unconditional  Flooding 

Link- View  Transmission 

When 

Measurement  Time 

Periodically 

(for  View  Update) 

(for  View  Update) 

Who 

Routing  Node 

Routing  Node 

View  Update 

When 

When  Each  View  Update  Is 

When  Each  View  Update  Is 

Received 

Received 

What 

Encountered-Delay 

Estimate 

Exponential  Delay  Average 

Link-Cost  Computation 

Who 

Routing  Node 

Measurement  Node 

How 

Exponential  Model 

Exponential  Averaging 

(with  View) 

(with  Measurement) 

When 

Route  Update 

Periodically 

(for  View  Update  and 

Subsequent  Route  Update) 

What 

Least  Encountered-Delay- 

Least  Current-Delay- 

Estimate  Paths 

Estimate  Paths 

Route  Update 
(Using  Link  Costs) 

Who 

Routing  Node 

Routing  Node 

How 

Standard  Shortest-Path 

Standard  Shortest-Path 

Algorithm 

Algorithm 

When 

Arrival  of  a  Data  Packet 

Periodically 

(Just  after  View  Update) 
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4  Simulation 

To  show  the  overall  applicability  of  this  approach  to  link-state  routing,  we  compared  via 
simulation  a  routing  scheme  using  our  approach  with  SPF  (Shortest  Path  First),  link-state 
routing  technique.  For  simulation  studies,  we  used  MaRS,  the  Maryland  Routing  Simulator 
[Alaettinoglu,  1994;  Shankar,  1992],  We  tried  SPF  with  two  kinds  of  link-cost  functions,  a  delay 
cost  function  and  a  hop-normalized-utilization  function  [Khanna,  1989]. 

4.1  Network  configuration  and  scenarios 

We  conducted  studies  for  the  NSFNET-Tl-backbone  topology.  In  this  configuration,  there 
are  14  nodes  connected  via  21  links.  Each  link  represents  two  one-way  channels.  Each  node 
can  process  a  data  packet  of  544  bytes  in  1  ms,  and  each  link  channel  has  183  KB/s  (1.4 
Mbps)  bandwidth.  We  assume  that  there  is  no  propagation  delay  for  each  link  because  we 
found  that  simulation  results  are  not  sensitive  to  the  setting  of  propagation  delay. 

In  this  network,  a  workload  is  generated  by  FTP  source  and  sink  pairs.  These  sources  and 
sinks  are  connected  to  nodes.  FTP  is  regulated  by  a  flow-control  mechanism  and  an 
acknowledgement  mechanism  with  retransmission.  The  flow-control  mechanism  is  a  static 
window-based  scheme  implemented  in  MaRS.  This  scheme  consists  of  two  windows:  produce 
and  send  windows.  We  set  the  produce-window  size  to  infinity,  and  the  send-window  size  to 
eight.  Also,  we  use  120  seconds  as  the  total  simulated  time. 

There  are  two  kinds  of  FTP  flows:  regular  and  on-off  flows.  In  each  regular  flow,  the  source 
starts  transmitting  packets  at  time  0,  and  sends  as  many  packets  as  possible  with  an  inter¬ 
packet  production  delay  of  1  ms.  For  each  on-off  flow,  there  are  alternating  constant-length  on 
and  off  intervals.  Each  on-off  flow  starts  at  a  different  time  (from  0  to  24  seconds),  and  has  a 
different  length  (from  20  to  120  seconds).  Also,  a  certain  number  of  packets  are  produced  at 
once  at  the  beginning  of  on  intervals  while  no  packets  are  produced  during  off  intervals.  The 
number  of  packets  for  each  on  interval  is  determined  so  that  the  packets  of  that  number  would 
be  successively  transmitted  during  the  on  interval  without  any  flow-control  mechanism  and 
without  any  other  flow.  Specifically,  the  number  is  the  length  of  an  on  interval  divided  by  the 
transmission  time  of  a  data  packet,  where  the  transmission  time  is  the  packet  size  divided  by 
the  link  bandwidth. 
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We  initially  consider  five  scenarios  in  this  network  configuration:  NO  -  N4.  The  level  of 
queuing  delay  of  these  scenarios  is  high:  in  the  best  cases  (lowest-average-delay  cases  after 
cost-function-parameter  tuning)  of  using  SPF  with  1  second  route-update  intervals,  the 
average  queuing-delay  portions  of  the  average  round-trip  delay  per  packet  are  around  94  %. 
Also,  the  utilizations  (the  average  fractions  of  the  time  when  packet  queue  size  >  1)  are  around 
0.73.  There  are  121  FTP  flows  in  Scenario  NO  to  N3,  and  131  flows  in  Scenario  N4.  Table  3 
shows  the  differences  between  the  scenarios.  In  particular,  Scenario  N4  has  two  hot  spots 
(each  of  which  receives  packets  from  every  other  node). 


Table  3  Differences  in  the  FTP-flow  characteristics  between  scenarios 


Scenario 

Number 
of  Tegular  Flows 

Number 
of  On-Off  Flows 

Fength  of  On-Off 
Intervals  (Seconds) 

NO 

60 

61 

5 

N1 

60 

61 

10 

N2 

60 

61 

15 

N3 

0 

121 

5 

N4 

55 

76 

5 

4.2  Results 

For  the  InfoDyn  scheme,  we  used  an  exponential-change -rate  ( a )  value  and  a  threshold  value 
for  the  selective  broadcast  of  routing  packets,  during  each  simulation  mn  for  each  scenario. 
We  tried  seven  threshold  values.  Also,  we  tried  eight  a  values  across  the  full  value  range  in 
each  of  these  different- threshold- value  cases.  As  the  steady-state  value  of  each  link  in  each 
simulation  mn  using  the  InfoDyn  scheme,  we  used  the  sample  delay  mean  of  the 
corresponding  link  computed  in  a  simulation  run  using  SPF  with  1  second  route-update 
intervals  for  the  same  scenario. 

The  use  of  the  InfoDyn  scheme  without  any  routing-packet  broadcast  (thereby  with  only  local- 
link  view  update)  is  called  the  InfoDyn  Short-Term  Steady-State  (STSS)  case.  Hereafter,  “best” 
means  leading  to  the  lowest  average  round-trip  delay  per  packet. 

4.2. 1  InfoDyn  Short-Term  Steady-State  (STSS)  case 

In  each  scenario,  we  compared  the  InfoDyn  STSS  case  of  using  the  best  a  of  the  exponential 
model  with  the  best  cases  of  using  SPF  with  1,  10,  and  30  second  route-update  intervals  -  we 
obtained  the  best  result  of  using  SPF  for  each  combination  of  a  route -update-interval  length 
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and  a  scenario  by  tuning  several  cost-function  parameters.  In  this  comparison,  the  InfoDyn 
case  results  in  a  3  to  8  %  reduction  in  the  Average  (Avg)  Round-Trip  (RT)  delay  per  packet 
and  a  4  to  22  %  reduction  in  the  standard  deviation  (STD)  in  all  scenarios.  Figure  5  shows 
these  reductions.  Note  that  there  are  no  routing  packets  sent  out  in  this  InfoDyn  case  while 
75,642,  7,602,  and  2,562  routing  packets  are  sent  out  with  1,10,  and  30  second  route-update 
intervals,  respectively,  in  the  SPF  cases.  These  results  imply  that  when  every  node  knows  the 
“long-term”  steady-state  delay-mean  values  of  all  links  and  uses  our  routing  approach,  flooding 
requirements  can  be  significandy  reduced  (as  in  the  InfoDyn  STSS  case)  with  noticeable 
reductions  in  the  average  delay  and  the  variance,  compared  with  the  standard  link-state  routing 
approach  where  each  node  periodically  broadcasts  “short-term”  steady-state  values 
(exponential  averages)  for  link  delays. 


Reductions  in  the  Avg  RT  Delay  of 
InfoDyn  STSS  wrt  SPF  w /  Different 
Route-Update  Intervals 


Reductions  in  the  Avg-RT-Delay  STD  of 
InfoDyn  STSS  wrt  SPF  w /  Different 
Route-Update  Intervals 
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Figure  5  Reductions  in  the  average  round-trip  delay  and  STD  of  InfoDyn  STSS 

4.2.2  Impact  of  routing-packet  broadcast 

For  each  scenario  with  a  fixed  a  value,  the  average  delay  and  STD  are  almost  the  same  across 
simulation  mns  with  different  threshold  values,  except  for  those  mns  in  which  a  very  large 
number  of  routing  packets  are  broadcast.  For  example,  Figure  6  shows  the  impact  of  varying 
the  threshold  value  in  Scenario  N3  (the  all-on-off  case)  when  the  best  a  is  used.  There  are 
three  charts.  The  left-most  and  middle  charts  indicate  the  changes  in  the  average  delay  and 
STD,  respectively,  depending  on  the  threshold  value  used.  The  right-most  chart  shows  the 
numbers  of  routing  packets  used  for  different  threshold  values.  The  smaller  the  threshold 
value,  the  more  routing  packets  are  sent  out.  When  about  40,000  routing  packets  are  used  (the 
100  ms  threshold-value  case),  there  are  0.53  ms  and  0.66  ms  increases  in  the  average  delay  and 
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STD,  respectively,  compared  with  152.03  ms  average  delay  and  92.24  ms  STD  of  the  best  case 
(the  130  ms  threshold-value  case).  Similar  impacts  of  routing-packet  broadcast  are  observed 
for  the  other  scenarios.  Appendix  C  (Figure  A1  on  pages  29  and  30)  shows  the  same  three 
charts  in  each  row  for  each  of  the  other  scenarios.  As  in  Figure  6  (and  also  in  Figure  Al),  for 
the  threshold  values  that  correspond  to  less  than  100,000  routing  packets  in  each  scenario,  the 
variation  of  the  average  delays  is  within  1  ms  and  that  of  STDs  is  within  5  ms.  Note  that  these 
numbers  are  the  scale  units  of  the  delay  and  STD  charts,  respectively. 


Avg  RT  Delay  for  Different 
Threshold  Values 


Avg-RT-Delay  STD  for  Different 
Threshold  Values 


The  Number  of  Routing  Packets 
for  Different  Threshold  Values 


Threshold  (ms) 


Threshold  (ms) 


-Avg  RT  Delay  (ms) 


-Avg-RT-Delay  STD  (ms) 


-  Number  of  Routing  Packets 


Figure  6  Impact  of  varying  the  threshold  in  Scenario  N3 
(when  using  the  InfoDyn  scheme  w/  the  best  a  ) 

The  average  delay  and  STD  range  from  152.0  to  161.9  ms  and  from  89.7  to  109.1  ms, 

respectively,  in  the  best  cases  of  using  the  InfoDyn  scheme  (with  the  best  a )  in  all  scenarios 

when  routing  packets  are  broadcast.  Compared  with  this  best  case  for  each  scenario,  the 

InfoDyn  STSS  case  with  the  same  best  a  leads  to  increases  in  the  average  delay  and  STD  by 

up  to  0.1  ms  and  0.3  ms,  respectively.  The  reason  why  these  increases  are  small  is  that  the 

impact  of  a  routing  packet  on  routing  quality  is  transient:  the  encountered  link  delay  estimated 

by  the  receiving  node  using  the  delay  measurement  contained  in  the  packet  soon  becomes 

close  to  the  steady-state  value.  These  results  indicate  that  each  node  may  not  need  to  broadcast 

link-delay  measurements  when  using  the  InfoDyn  scheme. 
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4.2.3  Impact  of  varying  the  a  value 

There  are  two  possible  sources  for  the  routing-quality  improvement:  use  of  the  long-term 
steady-state  link-delay  means  and  link-delay  estimation  with  the  exponential  delay-mean 
change.  To  see  the  influence  of  each  of  these  factors,  we  first  set  a  to  infinity.  Then,  the  link- 
delay  means  are  used  without  any  change  in  route  determination.  In  the  InfoDyn  STSS  case, 
this  Static -Routing  case  leads  to  up  to  5  %  and  1 8  %  increases  in  the  average  delay  and  STD, 
respectively,  in  four  scenarios  and  2  %  and  9  %  decreases,  respectively,  in  one  scenario 
compared  with  the  best  cases  of  using  SPF.  These  results  mean  that  the  use  of  the  link-delay 
means  is  not  a  source  of  routing-quality  improvement  in  most  cases.  However,  the  use  of  the 
best  a  results  in  4  to  11  %  and  7  to  22  %  decreases  in  the  average  delay  and  STD, 
respectively,  in  all  scenarios  compared  with  these  Static-Routing  cases.  These  results  indicate 
that  the  selection  of  the  a  value  is  cmcial  for  routing-quality  improvement. 

The  best  routing  quality  is  achieved  with  the  same  a  across  all  scenarios  in  the  case  of  using 
the  same  threshold  value  or  in  the  InfoDyn  STSS  case.  For  example,  Figure  7  shows  the 
effects  of  using  different  a  values  in  Scenario  N3  in  the  InfoDyn  STSS  case.  The  left  and 
right  charts  indicate  the  changes  in  the  average  delay  and  STD,  respectively,  depending  on  the 
a  value.  As  in  the  figure,  the  average  delay  and  STD  increase  as  the  a  value  used  digresses  in 
both  directions  from  the  value  (1,000)  for  the  best  result.  Similar  trends  are  observed  for  the 
other  scenarios.  Appendix  D  (Figure  A2  on  pages  31  and  32)  shows  the  same  two  charts  in 
each  row  for  each  of  the  other  scenarios.  Therefore,  if  we  can  find  the  best  or  a  near-best 
setting  in  one  case,  we  may  reduce  the  average  delay  and  STD  by  using  the  same  setting  in 
other  cases.  In  fact,  routing  quality  is  improved  for  a  wide  range  of  a  values.  Table  4  shows 
the  a  ranges  of  the  InfoDyn  STSS  cases  in  all  scenarios  that  lead  to  decreases  in  the  average 
delay  with  respect  to  the  best  SPF  cases.  Therefore,  the  parameter  tuning  is  not  required. 
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Avg  RT  Delay  for  Different  Avg-RT-Delay  STD  for  Different 

Exponential-Change  Rates  Exponential-Change  Rates 


-Avg  RT  Delay  (ms) 


-Avg-RT-Delay  STD  (ms) 


Figure  7  Impact  of  varying  the  a  value  in  Scenario  N3 
(in  the  InfoDyn  STSS  case) 


Table  4  a  ranges  of  the  InfoDyn  STSS  cases  leading  to  decreases  in  the  average  RT 

delay  wrt  the  best  SPF  cases 


Scenario 

Rate  ( Circled  if  Routing  Q 

uality  is  Improved) 

Static  Route 

100,000 

10,000 

1,000 

100 

10 

/ 

0 

NO 

O 

O 

o 

o 

O 

o 

N1 

o 

o 

o 

o 

o 

N2 

o 

o 

o 

N3 

o 

o 

N4 

o 

o 

4.2.4  Results  for  different  settings  of  other parameters 

As  for  InfoDyn  routing,  each  node  needs  to  estimate  the  steady-state  value  of  each  link  in 
order  for  our  approach  to  be  practical.  Our  simulation  results  indicate  that  each  node  may 
compute  the  sample  mean  of  the  delay  of  each  local  link  using  standard  link-state  routing  for  a 
long  period  of  time,  and  flood  the  sample  mean  periodically  (but,  at  a  lower  frequency)  so  that 
all  other  nodes  can  use  it  as  the  steady-state  value. 

We  confirmed  via  simulation  the  benefit  of  broadcasting  the  sample  delay  mean  for  each  link 
at  a  lower  frequency.  We  changed  the  implementation  of  InfoDyn  so  that  the  sample  mean 
can  be  periodically  computed  and  used  during  the  next  interval.  For  the  first  interval,  we  used 
the  sample  delay  mean  of  the  corresponding  link  computed  in  a  simulation  mn  using  SPF  with 
1  second  route-update  intervals  for  the  same  scenario.  In  this  experiment,  we  used  Scenario 
N3.  Table  5  shows  percent  decreases  in  the  average  round-trip  delay  per  packet,  the  STD,  and 
the  expected  number  of  routing  packets  of  InfoDyn  STSS  (with  the  a  value  set  to  1 ,000)  for 
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different  lengths  of  sample-mean  update  interval  compared  with  the  best  SPF  case  with  1,  10, 
and  30  second  route-update  intervals.  Since  1  second  interval  length  leads  to  the  best  result  in 
the  case  of  using  SPF,  the  percent  change  in  the  routing-packet  number  is  estimated  with 
respect  to  that  for  1  second  interval  length.  As  the  table  shows,  if  the  sample  mean  is 
broadcast  at  40  second  intervals,  InfoDyn  STSS  is  better  than  the  best  SPF  in  terms  of  the 
average  delay,  the  STD,  and  the  expected  number  of  routing  packets  used.  Flowever,  as  the 
frequency  increases,  the  benefit  decreases  or  disappears. 


Table  5  Percent  decrease  in  the  average  delay,  the  STD,  and  the  expected  routing- 
packet  number  of  InfoDyn  STSS  compared  with  the  best  SPF  (w/  1  second  route- 
update  interval  length)  -  negative  numbers  indicate  percent  increase 


Sample-Mean  Broadcast  Interval 
Length  (sec.)  of  InfoDyn  STSS 

Decrease  (%) 

Average  Delay 
per  Packet 

STD 

Expected  Number  of 
Touting  Packets 

40 

3 

2 

98 

1 

-6 

97 

-5 

-11 

95 

10 

-9 

-25 

90 

Currently  high-speed  networks  are  used  in  many  places.  We  changed  the  experimental 
environment  to  see  whether  or  not  the  InfoDyn  routing  is  effective  in  this  situation.  We  used  a 
high-speed-network  setting  of  12.5  MB/s  (100  Mbps)  link-channel  bandwidth,  0.4  ms  data- 
packet  processing  time,  5,000  byte  data-packet  size,  and  200  send-window  size  in  Scenario  N3 
(the  all-on-off  case).  Widi  this  setting,  the  InfoDyn  STSS  with  the  best  a  (which  is  also  1,000) 
of  the  exponential  model  results  in  a  2  to  5  %  reduction  in  the  average  round-trip  delay  per 
packet  and  a  3  %  increase  to  10  %  decrease  in  the  STD  compared  with  the  best  cases  of  using 
SPF  with  1,  10,  and  30  second  route-update  intervals.  This  result  demonstrates  that  the 
InfoDyn  routing  can  also  be  effective  for  high-speed  networks. 
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5  Related  Work 

Typically,  delays  vary  and  change  rapidly  in  a  network.  For  example,  at  a  fine-grained  level,  the 
characteristics  of  the  Internet  are  highly  dynamic  [Agrawala,  1998].  Such  dynamics  in  networks 
make  it  difficult  to  estimate  encountered  link  delays.  Many  researchers  have  investigated  the 
dynamic  behavior  of  networks  such  as  the  dynamics  of  end-to-end  Internet  packet  delays. 
[Agrawala,  1998;  Labowitz,  1998;  Paxson,  1999;  Pointek,  1997;  Sanghi,  1993]. 

For  statistical  uncertainty  modeling  concerning  information  estimation,  there  are  two  basic 
approaches:  modeling  based  on  past  observations  followed  by  extrapolation,  and  modeling  via 
the  analysis  of  factors  that  determine  the  information  at  the  target  estimation  time.  An 
example  of  the  first  modeling  approach  is  a  time-series  model  such  as  an  AutoRegressive 
Integrated  Moving  Average  (ARIMA)  model  [Box,  1994;  Chatfield,  1984].  An  example  of  the 
second  is  a  regression  model  for  factor(s)-and-effect  information  pairs  (or  tuples).  The 
parameters  of  both  modeling  approaches  can  be  estimated  using  least-squares  fitting  [Trivedi, 
1982]. 

Our  research  is  fundamentally  related  to  understanding  the  temporal  dynamics  of  information 
and  information  systems.  Information  plays  a  major  role  in  the  operation  of  systems.  In 
general,  such  information  used  in  or  generated  by  systems  is  also  dynamic  in  nature.  The 
Information-Dynamics  framework  [Agrawala,  2000]  provides  a  new  perspective  for  systems 
with  a  focus  on  information,  information  usefulness  (or  “value”),  and  the  changes  of 
information  and  its  usefulness  over  time.  Hence,  the  framework  allows  us  to  better  understand 
the  interactions  between  different  components  of  a  system.  Such  better  understanding 
provides  a  basis  for  better  system  design  and  implementation.  We  have  performed  research  on 
improving  link-state  routing  from  an  information-dynamics  perspective. 

Many  researchers  have  addressed  time-related  issues  regarding  the  model  of  time  and  its 
granularity,  time  representation,  information  processing,  and  distributed  computing.  Levi  and 
Agrawala  [Levi,  1990]  recognized  the  importance  of  an  appropriate  representation  of  time  in  a 
variety  of  applications.  Dyreson  et  al.  [Dyreson,  2000]  provided  a  formal  model  of  time  and  its 
granularity  in  a  database  context.  Lamport  [Lamport,  1978]  defined  the  “happen  before” 
relationship  as  a  partial  ordering  of  events  in  distributed  systems  where  entities  communicate 
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via  messages.  Based  on  this  relationship,  Chandy  [Chandy,  1985]  developed  an  algorithm  by 
which  an  entity  can  compute  a  global  state  of  the  system. 

Regarding  information  systems,  many  people  have  recently  performed  research  on  the 
behavior  of  entities  that  exchange  information.  Kephart  et  al.  [Kephart,  1998]  investigated  the 
dynamics  of  an  information-filtering  economy.  Later,  Brooks  et  al.  [Brooks,  2000]  showed  that 
a  price  war  in  the  information  goods  market  can  be  avoided  by  taking  on  different  strategies  to 
target  a  niche.  There  have  also  been  attempts  to  model  and/or  predict  e-commerce  entities’ 
behavior  using  a  stochastic  model  [Fader,  2000]. 
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6  Conclusion  and  Future  Work 

Regarding  link-state  routing,  we  have  studied  the  issue  of  estimating  and  using  future  link 
delays.  Our  simulation  results  indicate  that  our  approach  to  solve  this  problem  is  promising. 
To  address  the  future-delay  issue,  we  developed  a  routing  approach  based  on  a  new 
exponential-model-based  link-delay-estimation  technique,  and  implemented  a  routing  scheme 
that  uses  this  approach.  When  we  compared  this  routing  scheme  with  SPF  via  simulation  for 
various  FTP-workload  scenarios  with  the  NSF-T1 -backbone  network  topology,  we  found  that 
our  routing  scheme  could  achieve  100  %  reductions  in  routing  traffic  with  up  to  8  %  and  22  % 
decreases  of  the  average  round-trip  delay  per  packet  and  the  standard  deviation,  respectively,  in 
high-load  conditions.  In  comparison  studies  for  the  same  experimental  environment  with  a 
high-speed-network  setting,  we  found  that  our  scheme  could  lead  to  100  %  reductions  in 
routing  traffic  with  up  to  5  %  and  10  %  decreases  of  the  delay  and  the  standard  deviation, 
respectively,  in  high-load  conditions.  These  routing-traffic  reduction  and  routing-quality 
improvements  resulted  from  the  estimation  of  future  (encountered)  link  delays  based  on  the 
dynamics  of  the  expected  link  delay  given  an  instantaneous  link-delay  measurement,  and  from 
the  consideration  of  the  dynamic  usefulness  of  the  link-delay  measurement  via  this  estimation. 

There  will  be  various  issues  regarding  the  practical  use  of  our  approach.  We  plan  to  provide  a 
guideline  for  this  practical  use.  In  this  direction,  we  will  characterize  the  situations  where  we 
can  improve  link-state  routing  by  using  our  approach.  This  characterization  study  is  important 
for  the  practical  use  of  our  approach  because  simulation  studies  suggest  that  the  benefit  of 
using  this  approach  can  vary  depending  on  the  pattern  of  the  network  workload  and/ or  on  the 
characteristics  of  the  network.  For  this  research,  we  plan  to  investigate  the  effectiveness  of  our 
approach  via  extensive  simulation  studies  with  different  patterns  of  dynamic  workload  and/ or 
with  different  parameter  settings  for  the  network.  Based  on  the  results  of  these  studies,  we  will 
determine  the  characteristics  of  the  situations  that  lead  to  significant  routing-traffic  reductions 
with  routing-quality  enhancements  in  the  case  of  using  our  approach,  compared  with  standard 
link-state  routing. 
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Appendix 

A.  Theorem  Proof 

Theorem  If  x(t )  is  a  stochastic  process  and  has  the  following  additive  form  for  a 
constant  m  and  a  positive  constant  At : 

x(t  +  At)  -  m  =  [3  {x(t)  -  m)  +  (1  -  p)o(t) , 


then 

(i)  E{x(t)}  =  m  ,  Var{x(t )}  is  a  constant  (denoted  by  cr2),  and  the  autocorrelation  function 

p(t,t0)  =  E[{x(t0 )  -  m }  {x(0  -  m }]/ cr2 

(1  =  10  +  k(At)  for  a  non-negative  integer  £ )  decreases  exponentially  as  t  — 10  (or  k )  increases 
(depending  only  on  the  lag),  and 

(ii)  E{x(t )  |  x(t0)  =  x0}  =  x0  +  (m  -  x0){l  -  p(t,t0)} , 

where  /?  is  a  constant  such  that  0  <  /?  <  1 ,  and  o(t)  is  an  independent  white-noise  process 
such  that  E{u(t)}  =  0  and  Var{o(t )}  =  E{u2(t)}  =  cr2  (positive  constant)  □. 

Proof: 

Let  us  first  prove  Part  (i). 

The  additive  form  can  be  rewritten  as 

x(t)  -  m  =  (3 {x(t  -  At)  -  m}  +  (1  -  (3)o(t  -  At)  . 

By  successive  substitution  in  (1), 

x(t)  -  m  =  {x(t  -  2(At))  -m}  +  ( l-  (3)o(t  -  2(Al))]  +  (1  -  (3)u(t  -  At) 

=  p\(3{x{t  -  3(A t))  -  m)  +  (1  -  p)v(t  -  3(Al))] 

+  (1  -  P) pv(t  -  2(A t))  +  (1  -  p)v(t  -  At) 


(1) 


(2) 
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By  using  the  eventual  result  of  (2), 

x(t)  -m={  \-p)  {u(t  -  At)  +  pv(t  -  2(  A  t))  +  J32u(t  -  3(A  t))  +  •  •  •  } 


oo 

=  (i-/?)£{yr Mt-m))}  .  (3) 

i=i 

Taking  the  expectation  on  both  sides  of  (3)  yields 

00 

E{x(t)  -m)  =  (l  //>V|/(  Euti  h  \ni:  |  .  (4) 

i= 1 

Since  E{u(t)}  =  0 ,  it  follows  from  (4)  that 

E{x(t)-m}  =  0  .  (5) 

Since  E{x{t)  —  m }  =  E{x{t)}  —  m  ,  it  follows  from  (5)  that 

E{x{t)}  =  m  .  (6) 


Taking  the  expectation  on  the  squares  of  both  sides  of  (3)  yields 

00 

E[{x(t)  ~  m}2]  =  (1  -  ~  /(A0)}]2] 

i= 1 

00 

=0  - 

i= 1 

00  00 

+  (1-/?)2X  YtlP'-'P1 XE{uit-i{At))u{t-j(Atm  -  (V) 

i= 1  j=l,j*i 

Since  E{u(t1)u(t2)}  =  0  if  tx  ^  t2,  and  E{u2(t)}  =  (J2 ,  it  follows  from  (7)  that 


oo 

E[{x(t)-m}2]  =  (1-/?)2ctj£^2(M)  .  (8) 

i= 1 

Since  0  <  /?  <  1 ,  it  follows  from  (8)  that 

E[{x(t)  —  m}2]  =  (1  -  ft)2 <7* {1/(1  -/?2)} 

=  {(1-A)7(1-A2)K!  .  (9) 

Since  Var{x(t)}  =  E[{x{t)  -  m}2] 

Var{x(t)}={(l-j3)2/(l-/32)}cr2u  (10) 
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Since  cr '  =  Var{x(t )}  ,  and  x(t)  -  m  =  (1  -  P(t  -  i(At))}  (3), 

i=i 


Pito  +  (kAt),t0)  =  (l-PfE[YJ{piMt0  Mh  +  (M0-i(A0)}]  CJ2 


1=1 

CO  00 


;=i 


=  (1-^)2ZZ^'-1^ -*'(AOM^o  +(M0-J(A0)}]  v  (11) 

>=i  y=i  / 


Since  E{u(tl)u(t2)}  =  0  if  1,  ^  12 ,  -Ely  (l)}  =  <JV  ,  and  0  <  /?  <  1 ,  it  follows  from  (11)  that 


/)((„ +(4A1),10)  =  (1-/?)2£</?"-'/?mCT„2}  A2 

1=1  / 

=  (1-/?)V„2/?‘Zi»2<h>A2 

=  (i-/?)V2/?7{(i-/?v2}  .  02) 


Since  cr  =  {(1  —  /?)  /(l  —  (10),  it  follows  from  (12)  that 

p(t0  +  (kA  t),t0)  =  <j2/3k  /cr2 

=  P''  .  (13) 

Therefore,  E{x(t)}  =  m  (6),  Var{x(t )}  is  a  constant  (10),  and  since  t  =  t0+k(At)  and 
0  <  /?  <  1 ,  it  follows  from  (13)  that  the  autocorrelation  function  p(t,tQ )  decreases 
exponentially  as  t  —  t0  (or  k )  increases  (depending  only  on  the  lag). 


From  now,  let  us  prove  Part  (ii). 

For  t0  +  At ,  it  follows  from  the  additive  form  that 

x(t0  +  At) -m  =  J3{x(t0)  - m} +  (l- J3)u(t0)  .  (14) 

For  t0  +  2(Al)  =  (tQ  +  At)  +  At ,  it  follows  from  the  additive  form  that 

x(t0  +  2(A t))  -  m  =  P {x(t0  +  At)  -  m}  +  (1  -  fi)u(t0  +  At)  .  (15) 

It  follows  from  (14)  and  (15)  that 

x(t0  +  2(A  0)  -  m  =  p[p  {x(f0)  -  m)  +  (1  -  P)u(t0)]  +  (1  -  P)u(t0  +  At) 

=  P2{x(t0)-m}  +  (l-P){Pu(t0)  +  v(t0  +  At)}  .  (16) 

For  t0  +  3(Al)  =  (t0  +  2(Al))  +  At ,  it  follows  from  the  additive  form  that 

x(t0  +  3(At))-m  =  p{x(t0  +  2(At))-m} +  (\- P)o(t0  +  2(At))  .  (17) 
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It  follows  from  (16)  and  (17)  that 

x(t0  +  3(A t))  -  m  =  /3[(32{x(tQ)  -  m\  +  (1  -  p){pv(t0)  +  u(t0  +  Af)}] 

+  (l-/?Ml0+2(AO) 

=  J83{x(t0)  -  m)  +  (1  -  +  Mt0  +  At)  +  v((o  +  2(A 0}  (18) 

By  using  the  successive  substitution  shown  in  (14),  (16),  and  (18),  for  tQ  +  k(At)  ( k  >  0), 


x(t0  +  k(At))  -  m  =  pk  { x(t0)  -  m)  +  (1  -  /?)£  {pkllo{t0  +  z'(Al)}  .  (19) 

7  =  0 

Since  t  =  t0  +  k(At) ,  it  follows  from  (19)  that 

x{t)-m  =  pk{x{tQ)-m}  +  (\- /3)YJ{pk^'o{t0  +  i{At)}  .  (20) 

7=0 

(20)  can  be  rewritten  as 

x(t)  =  m+/3k{x(t0)-m}  +  (l-fi)YJ{fik-'1o(t0  +  i(At)}  .  (21) 

7=0 

The  non- white-noise  term  of  the  right  side  of  (21)  is 

m  +  J3k  { x(t0)  -  m)  .  (22) 


Given  x(l0)  =  x0,  (22)  is  not  a  random  variable.  Then,  x(t)  gets  its  randomness  only  from 

k-l 

(1  -  /?)^{/?A  '  lo(t0  +  z'(Al)}  .  Taking  the  conditional  expectation  on  both  sides  of  (21)  yields 

7=0 

E{x(t)  |  x(t0)  =  x0}  =  m  +  J3k  ( x0  -  m )  +  (1  “  P)Yj\-Pk  ‘  ^{^o  +  Z’(A0  I  *(*o)  =  xo)]  (23) 

7  =  0 

Since  x(t)  can  be  expressed  only  with  u(t)  (3),  and  u(t)  is  an  independent  process, 


E{v(t)\x(t0)}  =  E{v(t)}  .  (24) 

Since  E{v(t)}  =  0 ,  it  follows  from  (23)  and  (24)  that 

E{x(t)\x(t0)  =  x0}  =  m  +  J3k (x0  -  m)  .  (25) 


As  this  non-random  term  keeps  changing  its  value  (when  x0  ^  m),  E{x(t)  \  x(t0 )  =  x0}  ^  m  . 
Since  t  =  t0+  k(At)  and  p(t0  +  k(At),t0)  =  j3k  (13),  it  follows  from  (25)  that 

E{x(t)\x(t0)  =  x0}  =  m+p(t,t0)(x0-m )  .  (26) 

Since  m  +  p(t,t0)(x0  —  m)  =  x0  +  (m  —  x0){l  —  p(t,t0)}  ,  it  follows  from  (26)  that 
E{x(t)  |  x(t0)  =  x0}  =  x0  +  (m  -  x0){l  -  p(t,t0)} 
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B.  Additional  Theorem  and  Proof 

Additional  Theorem  If  x(t)  is  a  stochastic  process  and  has  the  following  additive  form 
for  a  constant  m  and  a  positive  constant  At : 

x(t  +  At)  -  m  =  P {x(t)  -  m }  +  (1  -  j3)o(t) , 

then  <j2(x0,t0,t)  (t  =  t0+k(At)  for  a  non-negative  integer  k )  decays  exponentially  over 
time  to  cr2,  where  a2  (x0,t0,t)  denotes  Var{x(t)  \  x(t0)  =  x0  }  ,  o2  denotes  Var{x{t)\  ,  /? 
is  a  constant  such  that  0  <  /?  <  1 ,  and  v(t)  is  an  independent  white -noise  process  such  that 
E{o(t)}  =  0  and  Var{v(t)}  =  E{o~(t)}  =  cr2  (positive  constant)  J. 

Proof: 

The  equation  (21)  in  the  proof  of  Theorem  (page  26)  is 

x(t)  =  m+/3k{x(t0)-m}  +  (l-/3)YJ{fiMo(t0+i(At)}  .  (1) 

i= 0 

Since  cr‘(x0  ,t0,t)  =  Var{x(t)  \  x(t0)  =  x0}  ,  it  follows  from  (1)  that 

cr2(x0,t0,t)  =  Var[(  1  -  /?)^ u(l0  +  /'(At)}  |  x(l0 )  =  x0 ] 

i=0 

=  (1  -pfE^iP^vito  +/(A1)}]2  |  x(t0)  =  x0] 

i= 0 
k- 1 


-(l-/?)2£2[X{/?i^o+'(AO}|^o)  =  ^o]  .  (2) 

i=0 

Since  x(l)  can  be  expressed  only  with  u(t)  (3)  in  the  proof  of  Theorem  (page  24),  and  v(t) 
is  an  independent  process, 

E{u2(t)\x(t0)}  =  E{u2(t)}  .  (3) 
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Since  E{u(t )  |  x(t0)}  =  E{u(t)}  (24)  in  the  proof  of  Theorem  (page  26),  it  follows  from  (2) 
and  (3)  that 


a-2  (x0  ,t0 ,  t)  =  (1  -  J3)2  £[[2  { +  i(At)}  ]2  ] 

1=0 

-(l- +*&)}]  .  (4) 

1=0 


Since  E{v(t1)v(t2)}  =  0  if  tx  ^  t2,  E{v  (l)}  =  <JV  ,  and  E{o(t)}  =  0 ,  it  follows  from  (4)  that 

1=0 

=  (1  -  pf  alp-1  {/T2  (1  -  p-u )/( 1  -  p-1 )} 

::d  /.•>  ,T-':  ,//  1>||//  •  I.  .  (5) 

Since  <7~=  {(1  —  /?)'/( 1  — (10)  in  the  proof  of  Theorem  (page  24),  it  follows  from  (5) 
that 


a2(x0T0,0  =  <T2(l-/?2*)  .  (6) 

Since  t  =  t0  +  k(At)  and  0  <  j3  <  1 ,  it  follows  from  (6)  that  a1  (x0  ,t0,t)  decays  exponentially 

2 

over  time  to  a  . 
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C.  Figure  for  the  Impact  of  Varying  the  Threshold  in  the  Other  Scenarios 
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Avg  RT  Delay  for  Different 
Threshold  Values 


Avg-RT-Delay  STD  for  Different 
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The  Number  of  Routing  Packets 
for  Different  Threshold  Values 
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([g],  [h],  and  [i] :  Scenario  N2) 
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([j],  [k],  and  [1]:  Scenario  N4) 

Figure  A1  Impact  of  varying  the  threshold  in  Scenarios  NO,  Nl,  N2,  and  N4 
(when  using  the  InfoDyn  scheme  w/  the  best  a  ) 


30 


Delay  (ms)  Delay  (ms) 


December  12,  2002 


D.  Impact  of  varying  the  a  value  in  the  Other  Scenarios 
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([c]  and  [d] :  Scenario  Nl) 
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([e]  and  [f]:  Scenario  N2) 
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([g]  and  [h]:  Scenario  N4) 


[h] 


Figure  A2  Impact  of  varying  the  a  value  in  Scenarios  NO,  Nl,  N2,  and  N4 

(In  the  InfoDyn  STSS  cases) 
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